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Abstract: The main objective of this study is to develop a shared design of master and slave 
devices for bilateral teleoperation mechanisms used for robotic excavators in agricultural 
applications. In robot teleoperation research, many potential applications within controlled and 
hazardous environments come to light. Robots, with their capacity for remote control by human 
operators through master devices, often employ the master-slave teleoperation approach. This 
strategy finds frequent use across manufacturing, construction, and agriculture industries. The 
master-slave system necessitates two interdependent components that collaboratively steer the 
robot in real time. However, challenges arise when manipulating the robot arm proves 
challenging due to structural differences between the master device (such as a joystick) and the 
slave device (the robot arm). A stable operational framework must be established for the robot 
to function optimally. This teleoperation system employs a master device to govern the actions 
of the slave device, a dynamic that heavily influences the operational complexity. Hence, the 
focal point of this study is to enhance the master-slave algorithm for teleoperation applications 
that rely on controlling robot arm movements. Despite the differing dimensions of the master 
and slave devices, they both share a common structure. The kinematic model bridging these 
components must be intelligible to ensure user-friendliness, facilitating effortless robot control. 
Calculating the robot arm's end effector movement and positioning involves employing the 
forward kinematics of the arm, determined through Denavit-Hartenberg parameters and 
transformation matrices. By mitigating communication delays between the master and slave 
devices using a technique centered around the robot arm's end effector position, the 
effectiveness of teleoperation can be significantly improved. Our designed robot arm attains 
80% to 100% precision across joints. In summary, streamlining the robot arm's structure and 
minimizing delays offers a route to bolstering both stability and efficiency in robotic movement. 


Introduction 

Agricultural robots are designed to automate tasks on 
farms and plantations. This type of robot, known as a 
mobile manipulator, consists of three main components: a 
perception system with image processing, a planning and 
localization system for moving the mobile platform, and 
a control system for navigating the manipulator's end- 
effector (Mail et al., 2023). The increasing demand for 
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food worldwide and a shortage of human labor for 
traditional, labor-intensive farming have led to significant 
attention on these robots in recent years (Crowley, 2020). 

Numerous efforts have been made to develop 
agricultural robots for various applications, including 
land preparation before planting, sowing and planting, 
plant treatment and protection, weeding and pest control, 
and harvesting and fruit picking. Substantial research on 
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harvesting and fruit-picking robots has focused on 
vegetables and small fruits (Kang et al., 2020; Wagner et 
al., 2021; You et al., 2020). These robots are generally 
designed for plants of lower height, as opposed to taller 
varieties like coconut and oil palm trees (Hudzari et al., 
2020; Sowat et al., 2018). 

Designing manipulators or robot arms for harvesting 
tall plants presents specific challenges due to height 
constraints (Chikelu, 2023; Firdaus et al., 2018; Hudzari 
et al., 2020; Khalid & Shuib, 2014). The manipulator's 
end-effector must be capable of reaching high positions, 
which can lead to instability if the mobile platform that 
supports the manipulator is not sufficiently heavy. On the 
other hand, if a heavy mobile platform is used to 
counteract instability, it raises concerns about the impact 
on the farmland. To address these requirements for both a 
high-end-effector position and overall stability, one 
approach is to retrofit a commercially available 
excavator, typically used for construction (Lee et al., 
2019; Sun et al., 2020), with a custom manipulator, 
ultimately creating a robotic excavator for agricultural 
purposes. 

Extensive research has been conducted on designing 
robotic excavators for various applications, including 
construction, mining, forestry, and others (Aguiar et al., 
2020; Correa et al., 2022; Lee et al., 2019). The boom 
and arm of the excavator can be likened to a robot arm. 
Regarding control, robotic excavators operate in two 
modes: autonomous and teleoperated. With a master- 
slave configuration, teleoperation offers diverse 
capabilities for robot arms, enabling a range of operations 
(Rai et al., 2023). However, it's important to note that 
using a master-slave system for teleoperation does have 
certain limitations (Lampinen et al., 2021; Liu et al., 
2019). In this framework, the master device directs the 
movement of processing devices, or slaves, in remote 
locations. 

Master-slave teleoperation entails controlling a robot 
model through a remote control device or joystick. This 
method is frequently employed in high-stakes fields like 
aerospace (Liu et al., 2019), manufacturing (Lee et al., 
2018; Zaman et al., 2020), oil and gas (Caiza et al., 
2020), and beyond. Differences in the design of robot 
arm structures between master and slave devices can pose 
control challenges. For instance, in the industrial sector, 
the master robot arm is typically smaller than its slave 
counterpart (Huang et al., 2017). Conversely, the medical 
sector may have larger master devices than slave devices 
(Schafer et al., 2019). 
complicates control for inexperienced operators, such as 


This structural discrepancy 


harvesting tasks in the agricultural sector, worsened by 


DOI: https://doi.org/10.52756/ijerr.2023.v35spl.011 


asynchronous movement between master and _ slave 
devices (Pan et al., 2017). 

For streamlined completion of tasks across distinct 
workspaces, employing a consistent design between slave 
and master devices within the master-slave system proves 
beneficial (Wang and Liu, 2022). Ensuring stability in 
robot movement entails precise and efficient control of 
position and orientation on large-size slave devices 
(Lawrence, 1993). Complex joint-flexible robot arms 
require composite adaptive control with teleoperation 
systems. Stability can be realized by adjusting the initial 
states of both master and slave devices. The compatibility 
of degrees of freedom between master and slave devices 
underpins two-way teleoperation stability (Tugal et al., 
2017). Choosing an appropriate controller hinges on 
specific application demands, encompassing robot arm 
type, desired precision, accuracy levels and operating 
environment. 

Differences in kinematic models between master and 
slave robot arms can impede operation and programming. 
Forward and inverse kinematic models are typically used, 
yet employing them across a master-slave teleoperation 
system with differing robot arms complicates the 
operational process. The robot kinematic model, which 
mathematically characterizes robot arm geometry and 
motion, can be described through the Denavit-Hartenberg 
(DH) convention and transformation matrix (Adzeman et 
al., 2020; Ting et al., 2021). DH convention models 
geometry and motion, while the transformation matrix is 
determined through DH parameters, describing relative 
orientation and position. 

Real-time delays in the master and slave robot arm 
system impede operations. A significant delay mismatch 
between master and slave devices hampers processes. 
Delays can occur in various control system levels, 
including communication, algorithm processing, and 
physical movement of the slave device (Kebria et al., 
2020; Yang et al., 2022). Reducing delay requires careful 
design and optimization of communication and control 
algorithms. A robust delay control technique based on 
position employs the robot arm's position information to 
balance delay and the control system. This method 
utilizes the robot arm's movement angle to determine end 
effector position. 

Therefore, in this research, the master and slave 
devices share a design, degrees of freedom, and 
kinematic model, enhancing teleoperation for robot arms. 
Minimizing delays between master and slave devices 
remains crucial, ensuring optimal operation efficiency for 
the master-slave robot arm. The study aims to design a 
master-slave robot arm, develop its kinematic model, and 
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formulate a teleoperation algorithm with minimal delay 
to create a coherent teleoperation system. 


Materials and Methods 

This study encompasses a holistic approach to 
enhancing robot arm control through the master-slave 
algorithm for teleoperation applications. Figure 1 
provides an overview of the research flow, including 
three sub-objectives for this study. The first sub-objective 
is to design a master device similar to the slave device, 
with different dimensions. Meanwhile, the second sub- 
objective is to derive the kinematic model for both the 
master and slave devices. Finally, a master-salve 
algorithm with minimal latency is developed. 


Design master device similar to slave 


Objective 1 : : 
device with different dimension 


Derive kinematic model for master and 


Objective 2 slave robot arms 


Movement 
satisfied? 


Develop a master-slave robot algorithm 
with minimal latency 
Minimum delay? 
Yes 


Figure 1. Research methodology 


Objective 3 


Robot Arm Design 

The design of the robot arm is rooted in the 
OpenManipulator-X robot arm configuration, boasting 
four degrees of freedom (DOF), as depicted in Figure 2. 
The openManipulator-X robot arm was selected due to its 
open-source nature and _ suitability to represent an 
available excavator's boom and arm, as shown in Figure 
3. The arm comprises joints 1, 2, 3, and 4, each rotating 
around the x, y, and z axes to emulate the excavator's 
movement depicted in Figure 3. Both master and slave 
devices share a design while differing in dimensions. The 
diagram illustrating this robot arm design, tailored for 
teleoperation applications, is presented in Figure 4. The 
master device is smaller and the slave device is larger, 
with dimensions outlined in Figure 2. Each joint of the 
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slave robot arm is connected to a corresponding 
potentiometer on the master device, totaling four sets of 
potentiometers due to the slave device's 4-DOF nature. 
Teleoperation is established to enable the master device 
to control the slave device using tools like a joystick. 


0,077m 


0.126m 


Figure 2. Dimensions of robot arm, model 


OpenManipulator-X, from Robotis company. 


az 


Figure 4. Available excavator with boom and arm 
mounted on a tractor (model B7001 from Kubota 
company) 


Slave: OpenManipulator-X 


Teleoperation 


Figure 4. Shared design of master-slave teleoperation 
with the master device is a potentiometer-based 
joystick, while the slave device is OpenManipulator-X 
robot arm. 
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Forward kinematic model 

The research employs the forward kinematic model 
the Denavit-Hartenberg (DH) _ convention 
technique. The initial step involves determining system 


using 


coordinates for each joint, followed by the derivation of 
the homogeneous transformation matrix for end-effector 
coordinates. A potentiometer on the master device gauges 
the movement angle of the OpenManipulator-X robot 
thus determining forward kinematics. This 
movement is then applied to the slave device. The offset 
between joints Zz and L3 introduces an offset angle on the 


arm, 


OpenManipulator-X robot arm, which is significant for 
DH parameter calculations. This involves trigonometric 
calculations, as depicted in Figure 5. 


0.024 


0.128 Io = 


Figure 5. Joint L2 and L3 offset angle calculation 


of the robot arm's 
configuration leads to the development of a kinematic 
diagram illustrated in Figure 6. DH parameters (as 
detailed in Table 1) are then determined for the 
OpenManipulator-X robot arm. 


A comprehensive analysis 


Figure 6. Kinematic diagram of OpenManipulator-X 
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Table 1. DH parameters of OpenManipulator-X 


Joint | a;(m) a;(°) d;(m) 6; (°) 
1 0 90 0.077 04 
2 | 0130 | 0 0 | 6,—0)+90° 
3 0.124 | 0 0 | 63+6,—90° 
4 0.126 | 0 0 0, 


Subsequently, the transformation matrix calculation is 
executed using the acquired DH parameters. Notably, the 
the 4-DOF 
OpenManipulator-X robot arm is 7°. Frame-specific 
matrix equations are written as follows, 
pi-1t — 


L 


transformation matrix limit for 


cos6@; sin@;cosa; sinO;sina; aj,cosa; 
sin6; cos@;cosa; —cos6;sina; a;sina; 
0 sin Qi; COS Qi; d; 
0 0 0 1 
aA beaming seas be nenen cnoesaenen scamaraamaanenaecernatneds (1) 
cos0, 0 sin@, O 
o _|sin@,; 0 -—cos@, O 
Tr = 0 1 ; Fy en a (2) 
0 0 0 1 
cos@, —sin@, 0 a,cos 6, 
1_|sin@, cos@, O a,sin@, 
Tz = 0 ij 1 0 ..-(3) 
0 0 0 1 
cos@3 —sin@3; 0 a3cos 63 
2_|sin@3; cos@3; 0 a3sin®63 
Ty = 0 0 1 0 ..(4) 
0 0 0 1 
T3 = 
cos0, —sinO, 0 a,cos64 
sin@, cos@, O a,gsinO, (5) 
0 0 1 Q 0 foccenre 
0 0 0 1 


The end effector's position is derived by simplifying 
the transformation matrix equation, as expressed in the 


following equation. 
Ny Ox ay Px 


To = Topic? 73 =|" % % Pyle 
4 1 2 3 4 tls Oz a Dz ( ) 
0 00 1 


The resultant position vector (px, py, pz), encompasses 
end effector coordinates (x, y, z). The master device's 
potentiometer and the slave device (the 
OpenManipulator-X robot arm) facilitate teleoperation 
within the same workspace due to a shared degree of 
freedom design. 

Position-Based Delay Control 

Position-based delay control is elucidated in Figure 7. 

Calculating delay time entails issuing a command from 
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the master device and then calculating the slave device's 
time to complete the command. Compensation position is 
subsequently determined based on the delay, predicting 
future arm position by accounting for current velocity. 
The calculated compensation position augments the 
command position, forming the new one. This guides the 
slave device's execution of the command with real-time 
monitoring and lag compensation updates. Movement 
accuracy, precision of final angles, and time delay are 
calculated as follows: 


Accuracy = [1 - nn eo xX 100% .......... (7) 


with Xm, Xs, Ym, and ys representing the initial and final 
positions of the master and slave robots, respectively. 


Precision = E - mi) X 100%... eee (8) 


ref 
with 6,¢ signifies the reference angle, while 6; denotes 
the final angle. 


Delay = (tem a tins) = (trs — tis 


with tim, tis, tim, and ty Corresponding to the initial and 
final times taken by the master and slave robots. 

Result and Discussion 

This section presents the outcomes of our 
investigation into robot arm control via the master-slave 
algorithm for teleoperation. We delve into the design of a 
master-slave system, employing forward kinematic 
modeling for the OpenManipulator-X robot arm and 
minimizing delays. 


Minimum 
delay? 


Yes 


Figure 7. Delay measurement flowchart 
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Master-Slave Shared Design 

To emulate the OpenManipulator-X robot arm, we 
have integrated its specifications into MATLAB for 
simulation. Utilizing potentiometers, we transform 
voltage readings into robot joint angles, steering the arm's 
movement. The simulation revolves around a master- 
slave system, where the master device (potentiometer) 
dictates the slave device (robot arm) motion. Designing 
for consistency, we employ four potentiometers 
corresponding to the 4-DOF nature of OpenManipulator- 
X. This uniform structure is visualized in Figure 4. 

The potentiometer data is transmitted through Arduino 
in MATLAB Simulink to ensure 
conformity within OpenManipulator-X's joint angle 
range. Subsequently, this processed data drives the 
MATLAB-designed 
OpenManipulator-X's_ specifications, as depicted in 
Figure 8. Besides, Figure 9 shows the corresponding 


and processed 
robot, 


characterized by 


Simulink Multibody program. 


@)OCMAMIG) x -f | time 100 
Figure 8. OpenManipulator-X design in MATLAB 


Forward Kinematic Model 

MATLAB is harnessed to develop the forward 
kinematic model for our master-slave robot arm. We 
analytically calculate DH parameters and _ the 
transformation matrix through MATLAB programming, 
simplifying end effector coordinate determination. We 
apply similar inputs directly to the potentiometer for 
robot arm implementation in MATLAB experiments. The 
initial OpenManipulator-X kinematic model is outlined in 
Table 2. 


Table 2. Initial OpenManipulator-X end effector 
coordinate 


Axis Position Coordinate 
X-axis 0.2748 
y-axis 0 
Z-axis 0.2046 
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Figure 9. MATLAB Simulink program to control OpenManipulator-X 


We validate our model by comparing analytical 
calculations with MATLAB simulations. Ten randomly 
chosen input angles yield corresponding end effector 
coordinates, visualized in Figure 10 for the x-axis, Figure 
11 for the y-axis, and Figure 12 for the z-axis. These end 
effector coordinates mimic the harvesting tasks in 
agricultural applications. 


0.5 
6) 
4 5 67 8 9 
-0.5 


=i 


x-axis Coordinate 
bh 
N 


Input Angle Set 


a= Analytic === MATLAB 


Figure 10. x-axis end effector coordinate 


y-axis Coordinate 


Input Angle Set 


a= Analytic «=== MATLAB 


Figure 11. y-axis end effector coordinate 


12345 6 7 8 9 10 


z-axis Coordinate 


Input Angle Set 


=—— Analytic === MATLAB 


Figure 12. z-axis end effector coordinate 
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Though exhibiting significant magnitude differences, 
the analytical and MATLAB end effector positions reside 
within the same workspace. However, discrepancies stem 
from factors like instrumentation error due to varying 
electronic component limits among potentiometer types. 
Calibration is paramount for accuracy, considering the 
potentiometer's sensitivity to even minor resistance 
changes. The findings can be utilized when retrofitting a 
commercially available excavator (as the slave device), 
typically used for construction, with a custom 
manipulator (as the master device), ultimately creating a 
safe robotic excavator for agricultural purposes. Besides, 
since this work is limited to the 4-DOF robot arm, further 
research with higher DOF needs to be studied in the 
future. 

Optimum Teleoperation Delay 

Precision, accuracy, and time delay are pivotal in 
teleoperation calculations. Both master and slave devices 
contribute to this study, interacting for motion 
synchronization. Accuracy, represented in Figure 13, 
gauges parallelism between master and slave robot arm 
movements, achieving 80% to 100% alignment. 
Simulation complexities necessitate a minute time step 
for heightened accuracy, even though this increases 
simulation intricacy. 

120 
100 
80 


60 


Accuracy (%) 


40 


—e—Simulation ——Optimum 


Figure 13. Accuracy of master-slave robot arm 
movements 


Precision, imperative for precise robot arm control, 
ensures accurate end effector positioning and trajectory 
tracking, as depicted in Figure 14. Our designed robot 
arm attains 80% to 100% precision across joints, 
underscoring its capability to accomplish tasks and attain 
specific positions. Time delays, inherent in master-slave 
teleoperation, stem from data connectivity. Calculations 
that emphasize accuracy, precision, and time delay, 
which involve master and slave devices, ensuring 
harmonious motion. Teleoperation accuracy and 
precision reside between 80% and 100%, influenced by 
real-time data acquisition, hardware limitations, and 
simulation intricacies. Figure 15 visualizes the time 
delay, ranging from -0.03s to 0.05s, impacting the 
efficiency of robot movement. 


120 
100 


6 2 


Precision (%) 
fon) 
oO 


— 61 ——62 63 —— 04 


Figure 14. Precision of final angle to reference angle 
for each joint 


Masa (s) 
oO 
ray 


Set 


Master device Slave device 


—— Time delay 
| 
Figure 15. Time delay in master-slave robot arm 
movements 


Conclusion 

This research introduces an effective master-slave 
teleoperation algorithm for robot arms. We enhance 
operational efficiency by adopting uniform design 
principles, implementing forward kinematic modeling, 


and minimizing delays. The potential for real-time data 
transmission via the Internet of Things (IoT) could 
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revolutionize teleoperation, particularly in dynamic fields 
like agriculture, mitigating labor challenges. 
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